How he wound up in the water off Route 23 in Wayne around 8:15 p.m. Thursday wasn't immediately clear.
Responders said the man ended up clinging to his rescuers' row boat before they pulled him in.
They brought him ashore in the backyard of a home on East Woodcliff Avenue on the Little Falls side of the river and emergency responders took it from there.
The man was taken to St. Joseph's University Medical Center in Paterson by hospital paramedics. Neither he nor the good Samaritans were immediately identified.
Click here to follow Daily Voice Garfield-Lodi and receive free news updates.